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Entropy functions and determinant inequalities 

Terence Chan, Dongning Guo, and Raymond Yeung 



Abstract — In this paper, we show that the characterisation of 
all determinant inequalities for n x n positive definite matrices 
is equivalent to determining the smallest closed and convex cone 
containing all entropy functions induced by n scalar Gaussian 
random variables. We have obtained inner and outer bounds 
on the cone by using representable functions and entropic 
functions. In particular, these bounds are tight and explicit for 
n < 3, implying that determinant inequalities for 3x3 positive 
definite matrices are completely characterized by Shannon-type 
information inequalities. 

Index Terms — Entropy, Gaussian distribution, rank functions 

I. Introduction 

Let n be a positive integer and denote the ground set by 
Af = {1, n} throughout this paper. Suppose K is an n x n 
positive definite matrix. For any subset a C Af, let K a be 
the sub-matrix of K obtained by removing those rows and 
columns of K indexed by Af \ a and its determinant be 
denoted by |if a |. Note that when a is the empty set, we will 
simply define K a as the scalar of value 1. There are many 
determinant inequalities in the existing literature that involve 
only the principle minors of the matrix. These include 

1) Hadamard inequality 

n 

i^i <n i^i t 1 ) 

i=l 

2) Szasz inequality 

( ^ ( 

n M M n M 

\/3CM:\p\=l j \P<ZM:\p\=l+\ j 

(2) 

for any 1 < I < k. 

As pointed out in HI, @ and to be illustrated in Section 
HIl many of such determinant inequalities (including the above 
two inequalities) can be proved via an information-theoretic 
approach. Despite that many determinant inequalities can be 
found in this approach, a complete characterisation of all de- 
terminant inequalities is still missing. In this paper, we aim to 
understand determinant inequalities by using the information 
inequality framework proposed in Q. 

II. Information inequality framework 

The framework proposed in provides a geometric ap- 
proach to understanding information inequalitiesLjIts idea will 
be illustrated shortly. 



Definition 1 (Rank functions): A rank function over the 
ground set Af is a real-valued function defined on all subsets 
of Af. The rank function space over the ground set Af, denoted 
by K 2 , is the set of all rank functions over Af. 

As usual, R 2 will be treated as a 2™-dimensional Euclidean 
space, so that concepts such as metric and limits can be defined 
accordingly. 

Definition 2 (Entropic functions): Let g be a rank function 
over Af. Then g is called entropic if there exists a set of 
discrete random variables {Xi,i 6 Af} such that g(a) is the 
Shannon entrop>0 H(Xi, i £ a), or H(X a ) for short, for all 
a CAf. 

On the other hand, if {Xi,i € Af} is a set of continuous 
scalar random variables such that g(a) is the differential 
entropy h(X a ) for all a C Af, then g is called s-entropic. 

Definition 3 (Entropic regions): Consider any nonempty fi- 
nite ground set Af. Define the following "entropy regions": 

r; = {g e M 2 " : g is entropic} (3) 
7* n = {g € M 2 : g is i-entropic}. (4) 

Understanding the above entropic regions is one of the most 
fundamental problems in information theory. It is equivalent 
to determining the set of all information inequalities O. 

In this paper, we will use the following notation. For any 
subset S C IR 2 ™, W(S) is defined as the set of all rank 
functions g* such that g* = c ■ g for some c > and g 6 S. 
The closure of W(6>) will be denoted by W(S). Finally, the 
smallest closed and convex cone containing S will be denoted 
by con(6>). Clearly, 

S C W(5) C W(5) C con(S). (5) 

Theorem 1 (Geometric framework [3]): A linear informa- 
tion inequality 

c a H(X a ) > 

is valid for all discrete random variables {Xi, . . . , X„} if and 
only if for all g € T* 

Y c <*9( a ) > °- 

aCTV 

By TheoremQ] characterising the set of all valid information 
inequalities is thus equivalent to characterising the set T*. 
Similar results can be obtained for the set 7*„. In the 
following, we will extend this geometric framework to study 
determinant inequalities. 



'See (4] Ch. 13-16] for a comprehensive treatment. 



2 A11 logarithms used in the paper is in the base 2. 
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Definition 4 (Log-determinant function): A rank function g 
over M is called log-determinant if there exists an n x n 
positive definite matrix K such that 



?(a) = logical 



(6) 



for all aC M. 



Let \? n be the set of all log-determinant functions over M. 
Then, we have the following theorem. 

Theorem 2: Let {c a ,a C M} be any real numbers. The 
determinant inequality 



n i*- 



> 1 



holds for all positive definite matrix K if and only if 



^2 c <x9( a ) > 

aCAf 



(7) 



(8) 



for all g 6 con(^„). 



Proof: By taking logarithm on both sides of the inequal- 
ity, (0 is equivalent to that 



E 



c a \os>\K a \ > 



(9) 



for all positive definite matrix K. As (0 is a linear inequality, 
it is satisfied by all g 6 $ n if and only if it is satisfied by all 
g £ con(^„). The theorem then follows. ■ 

In other words, the characterisation of the set of all determi- 
nant inequalities is equivalent to determining the set con(4'„). 
In the rest of the paper, we will obtain inner and outer bounds 
on con^n). 

To achieve our goal, we will take an information theoretic 
approach [2 |. The idea is very simple: Let {Xi, . . . ,X n } be 
a set of scalar Gaussian random variables whose covariance 
matrix is equal to (l/2ire)K. Then the differential entropy of 
X a is given by 



h(X a ) = ~lDg|Jir a |. 



(10) 



Definition 5 ( Scalar Gaussian function ): A function g S 
is called s-Gaussian if there exists scalar Gaussian 



p2" 



variables {Xi, . . . , X n } where 

g(a) = h(X a ) 

for all a C M. 



(11) 



From ( [Tol l, a rank function g is log-determinant if and only 
if ~<? is .s-Gaussian. Let T s ,„ be the set of all .s-Gaussian 
functions. Then 

co5(* n ) = con(T 5 , n ). 
Consequently, we have the following theorem. 
Theorem 3: The determinant inequality 

n \ K *\ ca > i 



holds for all positive definite matrix K if and only if 

J2 c a h{X a ) > 

aCAf 

for all scalar Gaussian variables {Xi, . . . , X n }. 

In fact, the Hadamard inequality and Szasz inequality are 
respectively the counterparts of the following basic informa- 
tion inequalities^] [5 1 



Y,h(X t )>h{X 1 ,...,X n 



h<Xp) > 1 



(?) 



I 



E 



I k \ 

yl+l) /3C7V:|^|=i+l 



l + l ' 



(12) 



(13) 



In the following sections, we will obtain inner and outer 
bounds on the set con(T S Jl ). The following corollaries of 
Theorem |2] show how these bounds can be used for proving 
or disproving a determinant inequality. 

Corollary 1 (Proving an inequality): Suppose S contains 
con(T s n ) as a subset. The determinant inequality (0 holds 
for all positive definite matrix K if 



^2 c *9( a ) > 



for all g e S. 



Therefore, any explicit outer bound on con(T s „) can lead 
to the discovery of new determinant inequalities. On the other 
hand, an inner bound on con(T s ra ) can be used for disproving 
a determinant inequality. 

Corollary 2 (Disproving an inequality): Suppose 
T C con(T s>n ). The determinant inequality (0 does 
not hold for all positive definite matrices if there exists g e T 
such that 



E 

aCTV 



c a g(a) < 0. 



III. An inner bound and an outer bound 

As discussed earlier, log-determinant functions are essen- 
tially the same as .s-Gaussian functions. Our objective is 
thus to characterise con(T s n ), or at least to understand its 
basic properties. Since scalar Gaussian random variables are 
continuous scalar random variables, the next lemma follows 
immediately from the definition. 



Lemma 1 ( Outer bound): 



, — * 

C Is 



(14) 



3 Han's inequality was originally proved for discrete random variables. 
However, by using the same proving technique, it can also be proved to hold 
for all continuous random variables (Tj. Alternative, its validity also follows 
from |6|: If a balanced information inequality (including Han's inequality) 
holds for all discrete random variables, then its "continuous counterpart" (i.e., 
the inequality by replacing discrete entropies with differential entropies) also 
holds for all continuous random variables. 
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and consequently, 



con(T S! „) C con(7* ). 



(15) 



It is well known that r„ (i.e., the closure of T* ) is a closed 
and convex cone 0. It was established in O that 



con(7*) =con(r*,^,...,C) 



(16) 



where 



— 1 if i e a 
otherwise. 



In the following, we prove an inner bound on con(T s ra ) by 
using representable functions. 

Definition 6 (s-representable function): A rank function g 
over Af is called s-representable if there exists real-valued 
vectors (of the same length) {Ai, . . . , A n } such that for all 

a C TV, 

g(a) — dim (Ai,i G a). 

In other words, g(a) is the maximum number of independent 
vectors in the set {Ai, i € a}. 

Theorem 4 (Inner bound): If g is s-representable, then 

g G W(T S> „). 



Let 



Proof: Suppose the length of each row vector Ai is k. 
{W u ...,W k ,V 1 ,...,V n } 



be a set of independent standard Gaussian random variables. 
Therefore, its covariance matrix is the (n+k) x (n+k) identity 
matrix. Let c > 0. For each i = 1, . . . , n, define a real-valued 
continuous random variable as follows 

Xi 4 -^ r A t [W ll ...,W k ] T + V t . 

LetX= [X 1 ,...,X n ] T . Then 

X=-^A[W 1 ,...,W k ] T +V 

where A is an n x k matrix whose i th row is A, and 
V = [V 1 ,...,V n ] T . 

Since Xi is zero-mean, 
Cov(X) = £[XX T ] 

= - c E[A[W ll ... 1 W k ] y [W 1 ,...,W k ]A v ] +1 

= - AA T + I. 

c 



Consequently, 



det(Cov(X)) =det [-D + I 



(17) 



where D is the diagonal matrix obtained by using singular- 
value decomposition (SVD) over AA T . Let d\ > d 2 > ■ ■ ■ > 
d n > be the diagonal entries of D and r be the rank of the 



matrix AA T (or equivalently, the rank of A). Hence, di > 
if and only if i < r. Then 



det(Cov(X)) = f[ (- + l) • 
i=i ^ c ' 



(18) 



It is easy to see that 
h(Xi, . . . ,X n 



lim 



lim 



o i log 1 /c c^O 



ilog((27re)"det(Cov(X))) 
\ log 1/c 



(19) 

lim l 0g (det(Cov(X))) (2Q) 



o log 1/c 

=lim EkMi±i) 

c^O log l/C 

= r. 

Similarly, for any a C {1, . . . , n}, we can prove that 



(21) 
(22) 



lim , 

c^o | log 1 /c 



= dim (Aj, i 6 a) = 



Thus, g e W(T S „) and the theorem is proved. ■ 

Lemma 2: Let {Xi,...,X„} be a set of scalar jointly 
continuous random variables with differential entropy function 
g. For any ci, . . . , c n > 0, define the set of random variables 
{Y 1 ,...,Y n }by 

Y t = Xj Cl , Vi g Af, 

and let g* be the differential entropy function of {Yi, . . . , Y n }. 
Then 



9* (") = +^ logCl 



(23) 



= g(a)-J2Vogc t )tf(a) (24) 

for all a C Af. Consequently, if g is s-Gaussian, then so is g* . 

Proof: Let fx u ...,x n and jy 11 ,„ l y n be respectively the 
probability density functions (pdfs) of {Xi,...,X n } and 
{Fi,...,y„}. Then 

/Yi,...,Y„(j/l, ■ • • ,2/™) 

= ^n^J /x"i.-»-y»( c ifi>---> c »j/n)> 

and d23l can be directly verified. ■ 
Corollary 3: 

con(Q s , n , ^, . . . , C) C con(T s ,„) C con( 7 * n ) 

= con(r; i >™,...,^) (26) 

where f2 S) „ is the set of all s-representable functions. 

Proof: A direct consequence of Lemmas Q] and |2j Theo- 
rem |U and (O. ■ 
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Proposition 1 (Tightness of inner and outer bounds): For 
n < 3, 

con(Q Sl „, 4>i, ...,()%) = con(T S! „) 

= cffi( 7 y = con(r;, . . . , <). (27) 

Proof: By Corollary[3] to prove the proposition, it suffices 
to prove that for n < 3, 

con(T* ) C con(Q s , n ). (28) 

In |[T6ll , the cone T* (when n < 3) was explicitly determined 
by identifying the set of extreme vectors of the cone. It can 
be proved that all the extreme vectors are s-representabl^| and 
hence is a subset of con(f2 S! „). Consequently, d28l holds and 
the proposition follows. ■ 

Proposition Q] does not hold when n > 4. In fact, 
con(f2 s .„, </>",..., 0") is in general a proper subset of 
con(T Si „) when n > 4. In fl2l . it was proved that all 
i-representable functions satisfy the Ingleton inequalities. It 
can also be directly verified that all the functions 0™ also 
satisfy the Ingleton inequalities. Therefore, all the functions 
in con(f2 S) „, </>",..., 0") also satisfy the Ingleton inequalities. 
However, in ifTOl . it was proved that there exists g G T s „ 
for n — 4 that violates the the Ingleton inequality. Thus, 
con(il s . n , (ft™, . . . , 0") is indeed a proper subset of con(T Sj „). 



Hence, 

T9i + T92 e W(T„, n ). 
k k 

Since k,£\,£2 are arbitrary positive integers, for any positive 
numbers c\ , C2 > 0, 

ciffi + C292 e W(T 0jTl ) 

and the lemma follows. ■ 

Theorem 5 (Another outer bound): 

con(T s ,„) C W(T v , n ). (30) 

Proof: A direct consequence of that T s „ C T v>n and 
Lemma |3] ■ 

So far, we have established two outer bounds ( TT3T > and (f30b 
for con(T s „). In the following, we will prove that ( f30b is in 
fact a tighter one. 

Definition 8: A rank function g is called v-entropic if there 
exists a set of random vectors {Xi, . . . , X n }, not necessarily 
of the same length, such that 

g(a) = h(X a ). 

Also, let 

7;„(A0 = {.9 e R 2 " : g is v-entropic}. (31) 



IV. Another outer bound 

By definition, the set con(^I'„) (which is the focus of 
our interest) is close under addition. However, this is not 
necessarily true for <3> n . In fact, W(^ n ) is not necessarily 
equal to con(^I'„). 

In the previous section, we showed that the set $> n is es- 
sentially equivalent to the set of s-Gaussian functions, defined 
via sets of scalar Gaussian random variables. It turns out that, 
if we relax the constraint by allowing the Gaussian random 
variables to be vectors, instead of scalars, we will obtain an 
outer bound for ^ and also con( , 5 n ). 

Definition 7 (Vector Gaussian function): A function g £ 
M 2 is called v-Gaussian if there exists n Gaussian random 
vectors {Xi, . . . , X n } such that 

g(a) = h(X a ) (29) 

for all a C TV. 

Lemma 3: con(T 1 , i „) = W(T„ jn ). 

Proof: It is clear from the definition that W(T„ „) C 
con(T„ -n ). Now, consider positive integers k,l\,l2 and 
5ii52 € Y Vtn . It is easy to see that 

l\9\ +4.92 e T v<n . 

4 In 1 16 1, the extreme vectors are proved to be representable with respect to a 
finite field. However, it can be verified easily that they are also s-representable 
with respect to the real field R. 



Clearly, W(T„ >n ) = c55(T„, n ) C con( 7 * „). Thus, 

con(T s ,„) C W(T„ in ) C con( 7 ;„). 

To show that ( f30b is tighter, it suffices to prove the following 
result. 

Theorem 6: = ^ = con(T* , ffi, 0"). 

Theorem [6] basically states that replacing the real-valued 
random variables Xi in the vector X by random vectors does 
not enlarge the closure of the space of differential entropy 
vectors. The discrete counterpart of this result is trivial, 
because as far as the probability masses and the entropy are 
concerned, a discrete random vector can be replaced by a 
scalar discrete random variable. However, in the continuous 
domain, it is not clear how a probability density function on 
M 2 or more generally W n can be mapped to a pdf on K without 
changing the entropies. In particular, there does not exist a 
continuous mapping from R 2 to R |9|. 

The proof of Theorem [6] exploits the relationship between 
the differential entropy of a continuous vector and the entropy 
of a discrete vector obtained through quantisation. Moreover, 
the entropy of the discrete random variable is equal to the 
differential entropy of a continuous random variable with 
piece-wise constant pdf. Given the n-tuple Z whose entries 
are vectors, we "quantise" Z by a discrete vector and then 
construct a continuous vector with n scalar entries whose 
entropy vector arbitrarily approximates that of Z. Before we 
prove the theorem, we need several intermediate supporting 
results. 
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Lemma 4 (Closeness in addition): If g\ and g 2 are V- 
entropic (or entropic) functions over Af, then their sum .91 + 92 
is also v-entropic (or entropic). 

Proof: Direct verification. ■ 

Proposition 2: If g* £ 7* „, then for any c > 0, c • g* £ 

lv,n' 

Proof: Let X = (X%, . . . , X n ) be a real-valued random 
vector with a probability density function. For any positive 
integer j, let X^',...,X«'' be j independent replicas of 
X (by a replica we mean a random object with identical 
distribution). Similarly, let U = (Ui, . . . , U n ) be a real-valued 
random vector such that U\, . . . , U n are mutually independent 
and each of them is uniformly distributed on the interval [0, 1]. 
Again, for any positive integer j, let . . . , be j 

independent replicas of U. It is easy to see that the joint 
density function of LA 1 ', . . . , U^' is uniform on a hypercube 
with unit volume and hence has zero differential entropy. 

Consider any c > 0. Let T be a binary random variable 
such that 

P {T = 1} = c/j and P {T = 0} = 1 - c/j 

where j is a positive integer. Assume that T is independent 
of 

(X( 1 ),[/«..,,XW ) [/W). 

Let Z = (Zi, ... ,Z n ) where each Zi is a random vector of 
length j such that for any i = 1, . . . , n, 



(U?\...,UV>) 



Zi = 



(Jh 



if T = 



otherwise. 



-0) 



(32) 



Z is evidently continuous with a pdf, which is a mixture of 
two pdfs induced by that of X and U. For any a C A/", we 
can directly verify that 



and 



Consequently, 



h(Z a \T = 0) = h(Jj£\...,UP) 
= 

^ a |T = l) = /i(xW,...,X«) 
= j'/i(X a ). 

h{Z a \T) = ch(X a ). 



Hence, 



= lim h(Z a |T) 
< lim h(Z a ) 



(33) 
(34) 

(35) 
(36) 

(37) 

(38) 
(39) 



< lim h(Z a \T) + h b (c/j) (40) 



ch(X a ), 



(41) 



where is the entropy of a binary random variable with 

probabilities cc and 1 — x. Thus, lim^oo h(Z a ) = ch(X a ). 
Let gJ and gr* be respectively the entropy function induced by 



{Zi, . . . , Z n } and {Xi, . . . , X n }. Then g J is u-entropic by 
definition and 

lim g J — c ■ g* . 

j-HX> 

Hence, c • g* £ 7* „ for all c > and our proposition follows. 



Proposition 3: 7* n is a closed and convex cone. 

Proof: For any r £ 7* „, by definition, there exists a 
sequence of u-entropic functions {r' l }°l 1 such that 



Thus, for any c > 0, 



lim r % = r. 

i— voo 



lim c • r 4 = c • r. 

i— ^00 



Then, by Proposition 12 c- r l £ 7* n and consequently, c - r £ 

lv,n' 

Consider any g*,^ € 7* n , and ci,c 2 > 0. Since 

ci • 51 and c 2 ■ g* 2 £ 7^, 

there exists sequences of v-entropic functions {r^}^ and 
{ri}£ x such that 

lim r\ = a - g\. 

i— >QO 

By Lemma |U r\ + r\ is also u-entropic. Thus, 

ci ■ g\ + c 2 ■ 52 e 7^. 

The proposition is proved. ■ 

Definition 9 (m-Quantization): Given m > 0, let the m- 
quantization of any real number x be denoted as: 

[x] m = ^ (42) 
m 

where [ij denotes the largest integer not exceeding t. Simi- 
larly, let the m-quantization of a real vector x — (xi, . . . , x n ) 
be the element-wise m-quantization of the vector, denoted by 
[x] m , i.e., 

[*^]m " ([*^l]m? • ■ • 5 [*^n]m) • (43) 

Evidently, [ only take values from the set 

1 2 I 
0,±-±-... . (44) 
mm J 

Hence for every real-valued random variable X, [X] m is a 
discrete random variable taking value in the set (l44i >. By 
definition, 



P{[X] 



i 

m 



1. 



(45) 



Proposition 4 (Renyi fi7§): If X is a real-valued random 
vector of dimension n with a probability density function, then 



lim H{[X} m )-n\ogm = h(X) 



(46) 



Under the assumption that the pdf of a random variable X 
is Riemann-integrable, Proposition |4] is established in J8| by 
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treating H([X] m ) — n log m as the approximation of the Rie- 
mann integration of — J fx(x) log fx(x)dx. It is nontrivial to 
establish the result in general, where the pdf is not necessarily 
Rieman-integrable. An example of such a pdf can be defined 
by using the Smith- Volterra-Cantor set. Nonetheless d46i i can 
be shown to hold using the Lebesgue convergence theorem 
along with some truncation arguments 171 . 

Lemma 5: Let {Xi, . . . ,X n } be a set of discrete random 
variables such that its entropy function is g. For any positive 
numbers ci, . . . , c„, let g* be defined as 

g*( a ) = g( a ) - X! logCj - 

Then g* is s-entropic. 



Proof: As Xi is discrete, we may assume without loss of 
generality that the sample space of is the set of integers 
Z. Let p(xi, . . . , x n ) be the probability mass function of 
{Xi, . . . ,X n }. Construct a set of continuous scalar random 
variables {Y%, . . . ,Y n } whose probability density function is 
defined as follows: 

fY U ...,Y n {vi, ■■.,y m )= p(L c i2/i-K ■ • ■ j L c ny«J)- 

It can then be directly verified that 



h(Y a ) = H(X a ) -J2 l °Sd, Va C TV. 



Consequently, g* is s-entropic. ■ 

Proof of Theorem® Clearly, 7* n C 7* n . We will now 
prove that 7* n C 7* n . Let Z = (Zi, . . . , Z n ) consist of n 
random vectors, where 

Zi = (Zis, . . . , Zi t k { )- 

Let us define the m-quantization of Zi, denoted as [Zi] m , 
be the element-wise m-quantization of Zi, i.e., it consists of 

\Zi. 



H,jim for j = 1, ... , fej. By Proposition |U 



lim 



H([Zi] m ,i e a 



)- ($>W 



Let g*,r m ,g m G M 2 " be such that 

r m (a) = ff([2i] m ,ie a ) 
.9™ (a) = r m (a) 




h(Z a ). (47) 



(48) 
(49) 



(50) 



By g7j, lim m _, ooS r m = g*. Also,_since r m £ T* n , g m G 7 *„ 
by Lemma |5] Consequently, g* G 7* „. We have thus proved 
that 7* n C 7^ and as a result, 7^ = 7^. Finally, by 
Proposition [3] 7* n is a closed and convex cone and is equal 
to coH(7* J. Then by (O, 



% n = c ° n ( r «^r> 

The theorem is proved. 



(51) 



In Theorem |U we have constructed an inner bound for 
con(T Si „) by using s-representable functions. The same trick 
can also be used for constructing an inner bound for the set 

W(T„,„). 

Definition 10: A rank function g over TV is called v- 
representable if for i = 1, . . . , n, there exists a set of real- 
valued vectors (of the same length) {Ai.i, . . . Aifa} such that 
for all a C TV, 



g(a) = dim (A id ,i €a,j = 1, 



, A'; 



The following theorem is a counterpart of Theorem |U The 
proving technique is the same as before. We will omit the 
proof for brevity. 

Theorem 7 (Inner bound on W(T„ n )): Suppose that g is 
v-representable, then g G W(T„,„) . 

Theorem |7J is of great interest. Characterising the set of v- 
representable functions have been a very important problem 
in linear algebra and information theory. It is also extremely 
difficult. For many years, it is only known that v-representable 
functions are polymatroidal and satisfies the Ingleton inequal- 
ities iPTTl . lfT2l . The set of representable functions is only 
known when n < 4. However, there were some recent break- 
through in this areas. In |[T3l . |[T4l . many new subspace rank 
inequalities which are required to be satisfied by representable 
functions are discovered. In particular, via a computer-assisted 
mechanical approach, the set of all representable functions 
when n < 5 has been completely characterised. Interesting 
properties about the set of v-representable functions were also 
obtained |15|. Theorems [4] and |7J thus opens a new door 
to exploit results obtained about representable functions to 
characterise the set of Gaussian functions. 

Corollary 4 (Inner bound on W(T„. n )): 

con(O w ,„,^,...,^) CW(T V ) 

where Vt vn is the set of all v-representable functions. 

Remark 1: While 

con(0 Sj „, O C con(T S! „), 

it is still an open question whether 

c6n(fl VtTl , 4% , . . . , 0") C con(T Si „) 

or not. 

We will end this section with a discussion of a related 
concept in a recent work JT0|. Gaussian rank functions were 
studied in [10|. However, their definitions are slightly different 
from ours. 



Definition 11 (Normalised joint entropy MOV ): Let 
{Xi,...,X n } be a set of n jointly distributed vector 
valued Gaussian random variables such that each vector Xi 
is a vector of length T. Its normalised Gaussian entropy 
function g is a function in M 2 such that 

g(a) 4 ±h(X a ). 
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The only difference between Definitions [5] and Q~T] is the 
scalar multiplier l/T. Hence, a normalised Gaussian entropy 
function must be contained in the set W(T 1 , „). In one sense, 
our proposed definition is slightly more general as we do not 
require all the random vectors X{ to have the same length. 
On the other hand, the "normalising factor" l/T in Definition 
[TTI can lead to some interesting results. For example, while 
we cannot prove that the closure of W(T s n ) is closed and 
convex, iflOl proved that the closure of the set of all normalised 
Gaussian entropy functions is indeed closed and convex. 

Proposition 5: Let Jf| be the set of all normalised 
Gaussian entropy functions. Then 

con( T 7v,J = con(T\,,rt). 

Proof: It can be directly verified from definitions that 
con(T^ n ) C con(T t ,.„). Now, consider any g € T VJl . 
Then by definition, there exists n Gaussian random vectors 
{Xi, . . . , X n } such that 

g(a) = h(X a ) (52) 

for all a C J\f. Let li be the length of the random vector Xi. 
Assume without loss of generality that £% > £i for all i. 

Let k = X]™=i(^i — ^i) m ^ Yi, ■ ■ ■ ,Y~k be a set of scalar 
Gaussian random variables with identity covariance matrix and 
independent of {Xi, . . . , X n }. For each i = 1, . . . , n, let = 

and 

| (X i; Y n+ x, . . . , Y ri+1 ) otherwise. 

Clearly, each Zi is a Gaussian vector with the same length 
l\. Let g* be the normalised entropy function induced by 
{Zi, . . . , Z n }. It is easy to verify that l^g* — g- Consequently, 
^v,n con(T^r n ) and the proposition thus follows. ■ 

Remark 2: Our Proposition [T] can also be derived from 
1 10 Theorem 5], which proved that for any g g T vn when 
n = 3, there exists a 9* > such that for all 9 > 9*, 
^g is vector Gaussian. However, their proof techniques are 
completely different. 



by Shannon-type information inequalities. Consequently, the 
aforementioned inner and outer bounds agree with each other. 
For n > 4, we showed the contrary, and the problem is 
seeming very difficult. 
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V. Conclusion 

In this paper, we took an information theoretic approach to 
study determinant inequalities for positive definite matrices. 
We showed that characterising all such inequalities for annxn 
positive definite matrix is equivalent to characterising the set of 
all scalar Gaussian entropy functions for n random variables. 
While a complete and explicit characterisation of the set is still 
missing, we obtained inner and outer bounds respectively by 
means of linearly representable functions and vector Gaussian 
entropy functions. 

It turns out that for n < 3, the set of all scalar Gaussian 
entropy functions is the same as the set of all differential 
entropy functions. The latter set is completely characterized 



5 The subscript N is a mnemonic for the word "normalised". 



